Interval Entropy and Informative Distance

Interval Entropy and Informative Distance

The Shannon interval entropy function as a useful dynamic measure of uncertainty for two sided truncated random variables has been proposed in the literature of reliability. In this paper, we show that interval entropy can uniquely determine the distribution function. Furthermore, we propose a measure of discrepancy between two lifetime distributions at the interval of time in base of Kullback-...

Finding Informative Rules in Interval Sequen es ?

Entropy Distance

Motivated by the approach of random linear codes, a new distance in the vector space over a finite field is defined as the logarithm of the “surface area” of a Hamming ball with radius being the corresponding Hamming distance. It is named entropy distance because of its close relation with entropy function. It is shown that entropy distance is a metric for a non-binary field and a pseudometric ...

Maximum Entropy and Interval Computations

Because these fields are closely related, and since this relation is not yet a common knowledge, I would like it to be known to the interval community. Yes, terms that we use are different, and mathematical methods are different, but these different methods are used to solve the same application problems. In solving these problems, interval and maximum entropy methods not only do not compete, t...

Regular Language Distance and Entropy

This paper addresses the problem of determining the distance between two regular languages. It will show how to expand Jaccard distance, which works on finite sets, to potentially-infinite regular languages. The entropy of a regular language plays a large role in the extension. Much of the paper is spent investigating the entropy of a regular language. This includes addressing issues that have ...